The Essential Role of Open Data and Software for the Future of Ultrasound-Based Neuronavigation

With the recent developments in machine learning and modern graphics processing units (GPUs), there is a marked shift in the way intra-operative ultrasound (iUS) images can be processed and presented during surgery. Real-time processing of images to highlight important anatomical structures combined with in-situ display, has the potential to greatly facilitate the acquisition and interpretation of iUS images when guiding an operation. In order to take full advantage of the recent advances in machine learning, large amounts of high-quality annotated training data are necessary to develop and validate the algorithms. To ensure efficient collection of a sufficient number of patient images and external validity of the models, training data should be collected at several centers by different neurosurgeons, and stored in a standard format directly compatible with the most commonly used machine learning toolkits and libraries. In this paper, we argue that such effort to collect and organize large-scale multi-center datasets should be based on common open source software and databases. We first describe the development of existing open-source ultrasound based neuronavigation systems and how these systems have contributed to enhanced neurosurgical guidance over the last 15 years. We review the impact of the large number of projects worldwide that have benefited from the publicly available datasets “Brain Images of Tumors for Evaluation” (BITE) and “Retrospective evaluation of Cerebral Tumors” (RESECT) that include MR and US data from brain tumor cases. We also describe the need for continuous data collection and how this effort can be organized through the use of a well-adapted and user-friendly open-source software platform that integrates both continually improved guidance and automated data collection functionalities.publishedVersio

Hessian-based Similarity Metric for Multimodal Medical Image Registration

One of the fundamental elements of both traditional and certain deep learning medical image registration algorithms is measuring the similarity/dissimilarity between two images. In this work, we propose an analytical solution for measuring similarity between two different medical image modalities based on the Hessian of their intensities. First, assuming a functional dependence between the intensities of two perfectly corresponding patches, we investigate how their Hessians relate to each other. Secondly, we suggest a closed-form expression to quantify the deviation from this relationship, given arbitrary pairs of image patches. We propose a geometrical interpretation of the new similarity metric and an efficient implementation for registration. We demonstrate the robustness of the metric to intensity nonuniformities using synthetic bias fields. By integrating the new metric in an affine registration framework, we evaluate its performance for MRI and ultrasound registration in the context of image-guided neurosurgery using target registration error and computation time

Brain atrophy and patch-based grading in individuals from the CIMA-Q study : a progressive continuum from subjective cognitive decline to AD

It has been proposed that individuals developing Alzheimer's disease (AD) first experience a phase expressing subjective complaints of cognitive decline (SCD) without objective cognitive impairment. Using magnetic resonance imaging (MRI), our objective was to verify whether SNIPE probability grading, a new MRI analysis technique, would distinguish between clinical dementia stage of AD: Cognitively healthy controls without complaint (CH), SCD, mild cognitive impairment, and AD. SNIPE score in the hippocampus and entorhinal cortex was applied to anatomical T1-weighted MRI of 143 participants from the Consortium pour l’identification précoce de la maladie Alzheimer -Québec (CIMA-Q) study and compared to standard atrophy measures (volumes and cortical thicknesses). Compared to standard atrophy measures, SNIPE score appeared more sensitive to differentiate clinical AD since differences between groups reached a higher level of significance and larger effect sizes. However, no significant difference was observed between SCD and CH groups. Combining both types of measures did not improve between-group differences. Further studies using a combination of biomarkers beyond anatomical MRI might be needed to identify individuals with SCD who are on the beginning of the clinical continuum of AD

MRI Superresolution Using Self-Similarity and Image Priors

In Magnetic Resonance Imaging typical clinical settings, both low- and high-resolution images of different types are routinarily acquired. In some cases, the acquired low-resolution images have to be upsampled to match with other high-resolution images for posterior analysis or postprocessing such as registration or multimodal segmentation. However, classical interpolation techniques are not able to recover the high-frequency information lost during the acquisition process. In the present paper, a new superresolution method is proposed to reconstruct high-resolution images from the low-resolution ones using information from coplanar high resolution images acquired of the same subject. Furthermore, the reconstruction process is constrained to be physically plausible with the MR acquisition model that allows a meaningful interpretation of the results. Experiments on synthetic and real data are supplied to show the effectiveness of the proposed approach. A comparison with classical state-of-the-art interpolation techniques is presented to demonstrate the improved performance of the proposed methodology

Investigating the relation between striatal volume and IQ.

The volume of the input region of the basal ganglia, the striatum, is reduced with aging and in a number of conditions associated with cognitive impairment. The aim of the current study was to investigate the relation between the volume of striatum and general cognitive ability in a sample of 303 healthy children that were sampled to be representative of the population of the United States. Correlations between the WASI-IQ and the left striatum, composed of the caudate nucleus and putamen, were significant. When these data were analyzed separately for male and female children, positive correlations were significant for the left striatum in male children only. This brain structure-behavior relation further promotes the increasingly accepted view that the striatum is intimately involved in higher order cognitive functions. Our results also suggest that the importance of these brain regions in cognitive ability might differ for male and female children

Non-local MRI upsampling.

International audienceIn Magnetic Resonance Imaging, image resolution is limited by several factors such as hardware or time constraints. In many cases, the acquired images have to be upsampled to match a specific resolution. In such cases, image interpolation techniques have been traditionally applied. However, traditional interpolation techniques are not able to recover high frequency information of the underlying high resolution data. In this paper, a new upsampling method is proposed to recover some of this high frequency information by using a data-adaptive patch-based reconstruction in combination with a subsampling coherence constraint. The proposed method has been evaluated on synthetic and real clinical cases and compared with traditional interpolation methods. The proposed method is shown to outperform classical interpolation methods compared in terms of quantitative measures and visual observation